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SYSTEM, METHOD AND 
COMPUTER PRODUCT FOR 
BASELINE MODELING A 
PRODUCT OR PROCESS 

Background of Invention 

[0001] This disclosure relates generally to improving the quality and productivity of a 
product or process and more particularly to baseline modeling of a product or 
process. 

[0002] 

Baseline modeling of a product or process generally provides an understanding 
of the performance of an "ideal" product or process over time. An engine is one 
type of product or process that baseline modeling is suitable for use. Engine 
baseline modeling has a multitude of uses including, but not limited to, 
determining when an engine performs out of specification, predicting when an 
engine failure will occur, detecting abnormal conditions, determining the quality of 
an engine and designing new engines. Typically, engine baseline models are 
developed from data gathered from thermodynamic cycle analyses and simulation. 
First, models of ideal values are created, indexed by variables such as altitude, 
temperature, power setting, and air speed. Once data from the normal operation of 
the engine is available, these models are updated by analyzing data corresponding 
to a particular model characteristic. An engineer then looks for data that are similar 
for the specified engine variables (e.g., altitude, temperature, power setting, air 
speed), groups the similar data, averages them for each variable and performs 
other operations as desired. The engineer then plots data for each of the variables. 
The plots provide interrelationship information between each of the engine 



Page 1 



variables, which the engineer uses to create tables of typical operation parameters 
the baseline model. These tables of parameters are used as the basis of 
comparison for engine operation. Differences from the baseline model may 
indicate engine faults or deterioration trends. 

[0003] There are several problems associated with this type of engine baseline 
modeling. First, this type of engine baseline modeling is very labor intensive 
because the engineer has to review the data, find data that are similar, group and 
average the data, perform other desired operations on the data, plot the data and 
create tables. Another problem is that one engineer cannot readily reproduce an 
engine baseline model developed by another engineer because this process is very 
individualized. It is helpful if one engineer can reproduce the engine baseline 
model generated by another engineer to validate quality of the baseline. Another 
problem associated with this type of engine baseline model is that the resulting 
model does not provide a good "picture" of an engine operating outside normal 
conditions. Furthermore, this type of engine baseline modeling does not provide a 
measure of how good the developed model is. 

[0004] In order to overcome the above problems, there is a need for an automated 
approach to engine baseline modeling that standardizes the process to improve 
reliability by minimizing human interventions. 

Summary of Invention 

[0005] In one aspect of this disclosure, there is a system, method and computer 
readable medium that stores instructions for instructing a computer system, to 
perform engine baseline modeling. In this embodiment, an engine service database 
contains engine data. A preprocessor processes the engine data into a 
predetermined format. An engine baseline modeling component builds an engine 
baseline model from the preprocessed data, wherein the engine baseline model 
relates engine performance variables as a function of engine operating conditions. 

[0006] 

In a second aspect of this disclosure, there is a system, method and computer 
readable medium that stores instructions for instructing a computer system, to 
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perform engine baseline modeling. In this embodiment, an engine service database 
contains engine data. A preprocessor processes the engine data into a 
predetermined format. An engine baseline modeling component builds an engine 
baseline model from the preprocessed data using a regression analysis. The 
regression analysis relates engine performance variables as a function of engine 
operating conditions. A model diagnostics component evaluates the performance 
of the of the engine baseline model. 

[0007] In a third aspect of this disclosure, there is a system, method and computer 
readable medium that stores instructions for instructing a computer system, to 
perform engine baseline modeling of an aircraft engine. In this embodiment, an 
engine service database contains aircraft engine data. A preprocessor processes 
the aircraft engine data into a predetermined format. In particular, the 
preprocessor corrects the aircraft engine data to standard conditions derived for an 
aircraft engine. An engine baseline modeling component builds an engine baseline 
model from the preprocessed data using a regression analysis. In particular, the 
regression analysis relates engine performance variables as a function of engine 
operating conditions. A model diagnostics component evaluates the performance 
of the of the engine baseline model. 

[0008] In a fourth aspect of this disclosure, there is a system, method and computer 
readable medium that stores instructions for instructing a computer system, to 
perform engine baseline modeling of an aircraft engine. In this embodiment, an 
engine service database contains aircraft engine data. A preprocessor processes 
the aircraft engine data into a predetermined format. In particular, the 
preprocessor corrects the aircraft engine data to standard conditions derived for an 
aircraft engine. An engine baseline modeling component builds an engine baseline 
model from the preprocessed data using a regression analysis. In particular, the 
regression analysis relates engine performance variables as a function of engine 
operating conditions. The engine baseline modeling component also comprises a 
metric component to validate the engine baseline model. A model diagnostics 
component evaluates the performance of the of the engine baseline model. 
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[0009] In a fifth aspect of this disclosure, there is method and computer readable 
medium that stores instructions for instructing a computer system, to perform 
engine baseline modeling of an engine. In this embodiment, a user is presented 
with aircraft engine data. The user is prompted to select engine performance 
variables and engine operating conditions from the aircraft engine data to model. 
In response to the user selection, the engine data is preprocessed into a 
predetermined format. A regression is used to build an engine baseline model 
from the preprocessed data. 

[001 0] In a sixth aspect of this disclosure, there is a system, method and computer 
readable medium that stores instructions for instructing a computer system, to 
perform baseline modeling of a process, in this embodiment, a service database 
contains process data. A preprocessor processes the data into a predetermined 
format. A baseline modeling component builds a baseline model from the 
preprocessed data, wherein the baseline model relates process performance 
variables as a function of process operating conditions. 

Brief Description of Drawings 

[001 1] Fig. 1 shows a schematic diagram of a general-purpose computer system in 
which a system for performing engine baseline modeling operates; 

[001 2] Fig. 2 shows a top-level component architecture diagram of the engine 

baseline modeling system that operates on the computer system shown in Fig. 1; 

[001 3] Fig. 3 shows a flow chart describing actions performed by the engine baseline 
modeling system shown in Fig. 2; and 

[0014] Fig. 4 shows an architectural diagram of a system for implementing the engine 
baseline modeling system shown in Fig. 2. 

Detailed Description 

[0015] 

This disclosure describes a system, method and computer product for baseline 
modeling of a product or process such as an aircraft engine, however, the 
disclosure is applicable to any type of product or process where it is desirable to 
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model performance. Fig. 1 shows a schematic diagram of a general-purpose 
computer system in which a system for performing engine baseline modeling 
operates. The computer system 10 generally comprises a processor 12, memory 
14, input/output devices, and data pathways (e.g., buses) 1 6 connecting the 
processor, memory and input/output devices. The processor 1 2 accepts 
instructions and data from memory 14 and performs various operations. The 
processor 1 2 includes an arithmetic logic unit (ALU) that performs arithmetic and 
logical operations and a control unit that extracts instructions from memory 14 
and decodes and executes them, calling on the ALU when necessary. The memory 
14 generally includes a random-access memory (RAM) and a read-only memory 
(ROM), however, there may be other types of memory such as programmable read- 
only memory (PROM), erasable programmable read-only memory (EPROM) and 
electrically erasable programmable read-only memory (EEPROM). Also, memory 14 
preferably contains an operating system, which executes on the processor 1 2. The 
operating system performs basic tasks that include recognizing input, sending 
output to output devices, keeping track of files and directories and controlling 
various peripheral devices. 

[0016] 

The input/output devices may comprise a keyboard 1 8 and a mouse 20 that 
enter data and instructions into the computer system 1 0. Also, a display 22 may be 
used to allow a user to see what the computer has accomplished. Other output 
devices may include a printer, plotter, synthesizer and speakers. A communication 
device 24 such as a telephone or cable modem or a network card such as an 
Ethernet adapter, local area network (LAN) adapter, integrated services digital 
network (ISDN) adapter, Digital Subscriber Line (DSL) adapter or wireless access 
card, enables the computer system 10 to access other computers and resources on 
a network such as a LAN, wireless LAN or wide area network (WAN). A mass storage 
device 26 may be used to allow the computer system 1 0 to permanently retain 
large amounts of data. The mass storage device may include all types of disk 
drives such as floppy disks, hard disks and optical disks, as well as tape drives that 
can read and write data onto a tape that could include digital audio tapes (DAT), 
digital linear tapes (DLT), or other magnetically coded media. The above-described 
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computer system 10 can take the form of a hand-held digital computer, personal 
digital assistant computer, notebook computer, personal computer, workstation, 
mini-computer, mainframe computer or supercomputer. 

[001 7] Fig. 2 shows a top-level component architecture diagram of an engine baseline 
modeling system 28 that operates on the computer system 1 0 shown in Fig. 1 . 
Generally, the engine baseline modeling system 28 models the performance of an 
"ideal" engine for a specified type aircraft engine. An engine baseline model built 
with the engine baseline modeling system 28 has a multitude of uses. An 
illustrative, but non-exhaustive list of potential uses for an engine baseline model 
built from the engine baseline modeling system 28 includes monitoring engine 
status, predicting future engine behavior, diagnosing engine faults, determining 
when an engine performs out of specification, determining the quality of an engine 
and designing new systems for an engine. 

[001 8] In Fig. 2, there is an engine service database 30 that contains engine data for a 

variety of aircraft engines. The engine data comprises an assortment of engine 

performance information for each of the engines. Generally, engine performance 

information includes environmental data in which the engines operate such as 

altitude, air temperature, air speed, engine loading, engine temperature and 

pressure. One of ordinary skill in the art will recognize that the engine service 

database 30 may comprises other engine performance information such as mach, 

fan speed, etc. In addition, the engine service database 30 may comprise other 

data such as operational data. A non-exhaustive list of engine operational data 

stored in the engine service database 30 includes exhaust gas temperatures (EGT), 

shaft speed between compressors and turbines (Nl and N2), pressure combustion 

(P ) and fuel flow (WF). One of ordinary skill in the art will recognize that other 
c 

engine operational data may include engine bleed settings, vibration readings, and 
control mechanism settings. Also, the engine service database 30 may comprise 
other data such as aircraft operating and settings data (e.g., bleed settings). 

[0019] 

One of ordinary skill in the art will recognize that there are a variety of 
approaches to acquiring the above data and storing them in the engine service 
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database 30. For example, some data can be captured automatically using on-line 
data acquisition techniques, while other data can be captured using manually 
recording techniques or on-board data capture techniques. Furthermore, the 
engine service database 30 preferably stores the data in a format that permits 
users to import the data into other tools for further analysis, such as Microsoft 
EXCEL, Minitab, and SAS. 

[0020] The engine service database 30 may comprise other types of data for the 
engines. For example, the engine service database 30 may comprise service 
information for the engines. Generally, the service information will comprise 
information such as engine product information, age information of the engines 
and repair history of the engines (e.g., dates of service events, types of service 
events, etc.). Other types of engine data stored in the engine service database 30 
may include in-flight data, engine utilization data (e.g., where, when, how flown), 
ownership data, remote monitoring and diagnostics status data. 

[0021] Referring to Fig. 2, the engine baseline modeling system 28 comprises a 

preprocessor 32 that processes the engine data into a predetermined format. In 
particular, the preprocessor 32 comprises a data acquisition component 38 that 
extracts the engine data from the engine service database 30. The data acquisition 
component 38 acquires the service data by using commercially available modules 
available from Minitab, Microsoft, Oracle, etc, which directly extract the data into 
the engine baseline modeling system 28, however, one of ordinary skill in the art 
will recognize that one can write specialized code to extract the data into a 
common format and write additional specialized code to import that into the 
system. 

[0022] 

The preprocessor 32 performs computations that simplify future processing of 
the data, while a data scrubbing component 40 cleans the engine data. In 
particular, the preprocessor 32 performs operations that convert the data into 
standard units. For example, the preprocessor 32 can convert temperature data 
from Celsius to Kelvin or correct engine power setting data by the engine bleed 
settings. Other types of corrections that the preprocessor 32 may perform include 
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converting pounds to kilograms, altitude to pressure, knots and altitude to mach 
number. One of ordinary skill in the art will recognize that the listed corrections 
are only illustrative of some possibilities and are not exhaustive of other 
possibilities. Furthermore, one of ordinary skill in the art will recognize that the 
preprocessor 32 can perform the corrections in any manner desired (e.g., Celsius 
to Rankine) and is not limited to the above order. Examples of cleaning operations 
performed by the data scrubbing component 40 include discarding data elements 
with missing values, correcting simple typographical errors, discarding data 
elements with erroneous values out of reasonable operating range, etc. One of 
ordinary skill in the art will recognize that the listed cleaning operations are only 
illustrative of some possibilities and are not exhaustive of other possibilities. 

[0023] In addition, the preprocessor also comprises a data segmenting component 42 
that segments engine data into groups, nodes or clusters that represent similar 
operating conditions. The groups generally include engine performance variables 
such as power setting, altitude, air speed (mach number), and air temperature. One 
of ordinary skill in the art will recognize that other engine performance variables 
such as air humidity and control settings may be selected and that the disclosure 
should not be limited to these variables. Once the groups have been selected, then 
the data segmenting component 42 can segment the data into the particular group 
that it relates to. Once the data are segmented into the groups, then the data 
segmenting component 42 can use a cluster analysis to determine clusters of 
operating conditions. Alternatively, an engineer may assign bands of operations of 
interest for each of the variables. 

[0024] A ^ engine baseline modeling component 34 builds an engine baseline model 
from the data processed by the preprocessor 32. In particular, the engine baseline 
model built by the engine baseline modeling component relates the selected 
performance variables as a function of engine operating conditions using the 
processed data. Engine operating conditions include engine, aircraft and 
environmental conditions. In this disclosure, the engine baseline model is built 
from a regression analysis. Generally, a regression is the statistical science of 
determining an equation from a finite number of points that provides values of Y 
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for a given X t i.e., Y=f(X). In this disclosure, the equation to be determined can be 
expressed as: 

Y = f (altitude, temperature, power setting, air speed) (1) 

where altitude, temperature, power setting and air speed are the ^variables. The 
engine baseline modeling component 34 performs a regression to determine the 
above equation for each of the selected engine performance variables (i.e., power 
setting, altitude, air speed, and air temperature) during specified times that the 
engine is operating. For instance, the engine modeling component 34 can perform 
the regression on the data taken during the take-off, climb and cruise for any or all 
of the engine performance variables. One of ordinary skill in the art will recognize 
that more engine performance variables (air humidity, control settings, etc.) or less 
engine performance variables can be used in equation 1 . In addition, one of 
ordinary skill in the art will recognize that different combinations of engine 
performance variables can be used in equation 1 . 

[0025] In general, a regression fits a parametric equation to a set of data by solving 
for values of regression parameters such that the best fit to the data set is 
obtained. Multiple linear regression is a type of regression that solves the system 
of equations, minimizing the combined error, in this disclosure, the system of 
equations that the regression solves can be as follows: 

y[l] = a*power setting[l] + b*altitude[l] + c*temperature[l] + 
d*airspeed[l] + „. +error[l] 

y[2] = a*power setting[2] + b*altitude[2] + c*temperature[2] + 
d*airspeed[2] + ... + error[2] 

y[n] = a*power setting[n] + b*aMtude[n] + c*temperature[n] + 
d*airspeed[n] + . . . + error[n] (2) 
wherein a, b, c, d are the regression parameters and power setting[l], altitude[l], 
temperaturefl], airspeed[l], y[l]] are observed events. Again, one of ordinary skill in 
the art will recognize that the system of equations can differ depending on the 
selection of engine performance variables. 

[0026] The resulting parameter estimates for a, b, c, d are representative of the new 
baseline model. Instead of using tables to develop the baseline model as was done 
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in the past, there is now a simple equation that describes the baseline behavior of 
the engine, from which either the tables may be generated, or the equation can be 
applied directly. For example, a baseline model for exhaust gas temperature (EGT) 
might be as follows: 

EGT = 0.1 * power + 0.001 * altitude + 0.01* temperature + 0.05 * airspeed 

(3) 

in this example, an engine that had power set to 1 00, altitude at 1 000, 
temperature at 300, and air speed at 200, would result in a predicted EGT value of 
24 degrees, but might have a measured EGT value of 14 degrees, which would 
indicate that the engine was 1 0 degrees below the predicted value. 

[0027] The engine baseline modeling component 34 also comprises a metric 

component 44 that validates the engine baseline model. In particular, the metric 
component 44 validates the engine baseline model by examining the quality of the 
built model. In this disclosure, the metric component 44 determines the goodness 
of model fit by analyzing statistical "goodness of fit" metrics, such as R-squared, 
which is a common regression tool output. One of ordinary skill in the art will 
recognize that the metric component 44 can determine other metrics besides the 
R-squared metric such as the mean square error, sum square error and sigma 
metrics, which are other common regression tool outputs. 

[0028] The engine baseline modeling component 34 also comprises a data cleaning 
heuristics component 46 that cleans the preprocessed data according to a set of 
heuristics. Generally, the data cleaning heuristics component 46 uses heuristics to 
remove data that does not conform to the norm. An illustrative, but non- 
exhaustive list of data that the data cleaning heuristics component 46 removes 
includes regression outliers, regression leverage points, and faulty engines. In this 
disclosure, this data cleaning operation can be performed for groups of engines or 
fleets of aircraft that use a common engine. 

[0029] 

Fig. 2 also shows that the engine baseline modeling system 28 comprises a 
model diagnostics component 36 that evaluates the performance of the engine 
baseline model. In particular, the model diagnostics component 36 generates 
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statistical outputs that provide statistical information to a user of the engine 
baseline modeling system 28. An illustrative, but non-exhaustive list of the 
statistical outputs that the model diagnostics component 36 generates includes 
2 

variance, r , collinearity, probability plots, residual plots, standard error 
measurements, confidence limits on the engine baseline model, prediction limits, 

pure error lack-of-fit test, data subsetting lack-of-fit test, multicolinearity metrics 

(variance inflation factors), autocorrelation of residuals (Durbin-Watson statistic), 

etc. 

[0030] The algorithms performed by the components in the engine baseline modeling 
system 28 (i.e., the preprocessor 32, engine baseline modeling component 34 and 
model diagnostics component 36 can be programmed with a commercially 
available statistical package such as SAS, but other languages such as C or Java 
may be used. 

[0031] The engine baseline modeling system 28 is not limited to a software 

implementation. For instance, the preprocessor 32, engine baseline modeling 
component 34 and model diagnostics component 36 may take the form of 
hardware or firmware or combinations of software, hardware, and firmware. In 
addition, the engine baseline modeling system 28 is not limited to the 
preprocessor 32, engine baseline modeling component 34 and model diagnostics 
component 36. One of ordinary skill in the art will recognize that the engine 
baseline modeling system 28 may have other components. 

[0032] 

Fig. 3 shows a flow chart describing actions performed by the engine baseline 
modeling system 28 shown in Fig. 2. At block 48, the data acquisition component 
38 extracts the engine data from the engine service database 30. Next, at 50 the 
user of the engine baseline modeling system 28 selects a particular engine model 
and engine performance variables for that engine that he or she would like to 
model (e.g., power setting, altitude, air speed and air temperature). The 
preprocessor 32 converts data into a standardized format at 52 and the data 
scrubbing component 40 cleans the engine data at 54. The data segmenting 
component 42 then segments the engine data into groups such as altitude, air 
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speed and air temperature, fuel specific heat value, air humidity, control settings, 
etc. at 56. 

[0033] After the data segmenting component 42 has segmented the engine data into 
groups, the engine baseline modeling component 34 builds an engine baseline 
model from the data processed by the preprocessor 32. In particular, the building 
of the engine baseline model begins with the engine baseline modeling component 
34 performing a regression to determine parameters for each of the selected 
engine performance variables (e.g., altitude, air speed and air temperature) at 60. 
As mentioned above, the regression relates the engine performance variables as a 
function of engine operating conditions. The metric component 44 then 
determines the residuals of the regression at 62 and applies the metrics (e.g., R- 
square, mean square error, sum square error and sigma metrics) at 64. Next, the 
data cleaning heuristics component 46 cleans the preprocessed data according to a 
set of heuristics and generates certain statistics such as outliers and leverage 
points at 66. 

[0034] The engine baseline modeling component 34 then performs another regression 
at 68. The engine baseline modeling component 34 applies a second regression to 
improve the parameter estimates by using a cleaner data set. Again, the metric 
component 44 determines additional residuals at 70. Alternatively, the metric 
component 44 can generate plots of the residual if a user desires. At 72, the 
engine baseline modeling component determines whether there are any more 
segments that have to be analyzed. If there are more segments, then the next 
segment is analyzed at 74 and blocks 60-72 are repeated. This process continues 
until it is determined at 72 that there are no more segments. Once it has been 
determined that there are no more segments, then the model diagnostics 
component 36 evaluates the performance of the of the engine baseline model at 
76 and generates certain statistical outputs that relate to the model. 

[0035] 

The foregoing flow chart of this disclosure shows the functionality and 
operation of the engine baseline modeling system 28. In this regard, each block 
represents a module, segment, or portion of code, which comprises one or more 
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executable instructions for implementing the specified logical function(s). It should 
also be noted that in some alternative implementations, the functions noted in the 
blocks may occur out of the order noted in the figures or, for example, may in fact 
be executed substantially concurrently or in the reverse order, depending upon the 
functionality involved. Furthermore, the functions can be implemented in 
programming languages such as C and Java, however, other computer 
programming languages can be used. Also, the engine service database 30 may be 
constructed using commercial databases including standard relational, object- 
oriented or hierarchical databases. Data manipulation operations, including 
retrieval, creation, modification, and deletion, can be implemented within the 
programming languages or within the database using stored procedures or 
triggers or combinations. 

[0036] The above-described engine baseline modeling system 28 comprises an 

ordered listing of executable instructions for implementing logical functions. The 
ordered listing can be embodied in any computer-readable medium for use by or 
in connection with a computer-based system that can retrieve the instructions and 
execute them. In the context of this application, the computer-readable medium 
can be any means that can contain, store, communicate, propagate, transmit or 
transport the instructions. The computer readable medium can be an electronic, a 
magnetic, an optical, an electromagnetic, or an infrared system, apparatus, or 
device. An illustrative, but non-exhaustive list of computer-readable mediums can 
include an electrical connection (electronic) having one or more wires, a portable 
computer diskette (magnetic), a random access memory (RAM) (magnetic), a read- 
only memory (ROM) (magnetic), an erasable programmable read-only memory 
(EPROM or Flash memory) (magnetic), an optical fiber (optical), and a portable 
compact disc read-only memory (CDROM) (optical). 

[0037] Note that the computer readable medium may comprise paper or another 
suitable medium upon which the instructions are printed. For instance, the 
instructions can be electronically captured via optical scanning of the paper or 
other medium, then compiled, interpreted or otherwise processed in a suitable 
manner if necessary, and then stored in a computer memory. 
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[0038] Fig. 4 shows an architectural diagram of a system 78 for implementing the 

engine baseline modeling system 28 shown in Fig. 2 in a networked environment. 
In Fig. 4, a user uses a computing unit 80 to access the engine baseline modeling 
system 28 and engine service database 30. More specifically, the computing unit 
80 connects to the engine baseline modeling system 28 and engine service 
database 30 through a communication network 82 such as an electronic or 
wireless network. The computing unit 80 can take the form of a hand-held digital 
computer, personal digital assistant computer, notebook computer, personal 
computer or workstation, while the communications network may be a private 
network such as an extranet or intranet or a global network such as a WAN (e.g., 
Internet). A web server 84 serves the engine baseline modeling system 28 and the 
engine service database 30 to the user in the form of web pages. The web pages 
can be in the form of HTML, however, other formats and structures can be used 
such as SGML, XML or XHTML The user uses a web browser 86 running on the 
computing unit 80 such as Microsoft INTERNET EXPLORER, Netscape NAVIGATOR or 
Mosaic to locate and display the web pages generated from the engine baseline 
modeling system 28 and engine service database 30. 

[0039] If desired, the system 78 may have functionality that enables authentication 

and access control of users accessing the web pages linked to the engine baseline 
modeling system 28. Both authentication and access control can be handled at the 
web server level by a commercially available package such as Netegrity 
SITEMINDER. Information to enable authentication and access control such as the 
user names, location, telephone number, organization, login identification, 
password, access privileges to certain resources, physical devices in the network, 
services available to physical devices, etc. can be retained in a database directory. 
The database directory can take the form of a lightweight directory access protocol 
(LDAP) database, however, other directory type databases with other types of 
schema may be used including relational databases, object-oriented databases, 
flat files, or other data management systems. 

[0040] |t js apparent t ^ at t h ere b een provided in accordance with this invention, a 
baseline modeling system, method and computer product. While the invention has 
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been particularly shown and described in conjunction with a preferred embodiment 
thereof, it will be appreciated that a person of ordinary skill in the art can effect 
variations and modifications without departing from the scope of the invention. 
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